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Summary of Review 

A recent report from the Reason Foundation argues for significant changes in how 
public education is organized and delivered in large cities. The report argues that city 
schools should move toward a “portfolio” of schools model. In such a model, the district 
does not necessarily operate schools, but instead focuses on closing low-performing 
schools and opening new ones under the management of autonomous people or corpora- 
tions. The report cites improvements in student achievement in New Orleans that have 
accompanied a substantial shift in the city towards charter and autonomous schools. 
However, the heavy reliance on New Orleans is a significant weakness in this report, as 
there are myriad reasons unrelated to the portfolio approach that likely explain some or 
all of the gains, including substantial population shift of low-income children post- 
Hurricane Katrina and a significant increase in resources. The findings from New Orleans 
are supplemented by examples from other cities, but these examples and other arguments 
throughout the report rest not on systematic research but instead on carefully selected ex- 
amples intended to support a particular perspective. 





Review 



I, Introduction 

In a recent report for the Reason Foundation, 
entitled Fix the City Schools: Moving All 
Schools to Charter-Like Autonomy, Lisa 
Snell argues for dramatic changes in the or- 
ganization and delivery of publicly funded 
urban education.* Her ideas are closely 
linked to some of the changes happening in 
large cities, including Chicago, New York, 
Philadelphia, Washington, D.C., Los An- 
geles and New Orleans. Those cities have 
begun to shift away from a centralized bu- 
reaucracy that directly manages a relatively 
uniform set of schools, moving toward a 
model in which the central office oversees a 
“portfolio” of schools. Schools within the 
portfolio offer diverse organizational and 
curricular themes and include, as service 
providers, traditional public schools, private 
organizations, and charter schools. Professor 
Paul Hill of the Center for Reinventing Pub- 
lic Education at the University of Washing- 
ton in Seattle has been the leading advocate 
of the portfolio management approach.^ Dis- 
tricts adopting a portfolio model have 
schools that “are not assumed to be perma- 
nent but contingent,” and poorly performing 
schools are to be closed.^ 

Despite minimal evidence of success, at 
least to date, politicians from the left and 
right (including Presidents George W. Bush 
and Barack Obama), as well as prominent 
educational funders, have held up these dis- 
tricts as models for district reform. This new 
report advocates for a form of a portfolio 
model in which all or most schools are 
granted broad-based autonomy over staffing, 
budget and instructional programs, and in 
which schools are held accountable through 
the threat of school closure. 



II, Findings and Conclusions 
OF THE Report 

In this report, the author argues that, espe- 
cially in urban settings, providing all schools 
in urban districts with autonomy and ac- 
countability similar to that found in charter 
schools will foster school improvement. 
Charter schools themselves would be among 
the schools in a district’s portfolio, and the 
other schools in the portfolio would resem- 
ble charters in key ways. Such a shift would 
entail financing schools via a “student-based 
budgeting” approach, providing schools 
with revenue rather than particular numbers 
of staff positions, giving school principals 
additional autonomy, moving to a fully 
“open enrollment” system for allocating stu- 
dents to schools, and closing persistently 
low-performing schools instead of seeking 
to improve them. Snell also argues for al- 
lowing parents to request a school be re- 
structured, reforming collective bargaining, 
evaluating teachers without regard to senior- 
ity (but with attention to student perfor- 
mance), and publishing detailed information 
about district budgeting. 

III, The Report’s Rationale for 
Its Findings and Conclusions 

A significant basis for the report’s argument 
is evidence of improvements in student 
achievement in New Orleans. The author 
attributes these reported improvements pri- 
marily to the post-Katrina significant shifts 
in that city to a highly decentralized system 
dominated by charter schools (now serving 
roughly 60% of the city’s students) and tra- 
ditional public schools with greater autono- 
my. While the New Orleans case is used as 
the primary basis for arguing for the need to 
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move toward systems of autonomous 
schools, the report also offers a variety of 
other examples of cities that have adopted 
some of its recommendations. For example, 
the report describes reforms in New York 
City that offer schools greater autonomy, 
changes in Oakland and other cities that 
provide principals with greater control of 
budget decisions, increases in school choice 
in Baltimore, and examples of school clos- 
ings in Denver. 

IV, The Report’s Use of 
Research Literature 

The primary data for this report come from 
newspaper accounts, advocacy pieces, and 
the Reason Foundation’s own publications. 
Snell does not draw on original pieces of 
research. In some cases, she addresses issues 
that have been assessed in high-quality re- 
search, but neglects to include that research 
or its findings. For example, she argues that 
closing schools can have a positive effect on 
student achievement, citing internal (and not 
publicly available) analyses from Denver. 
Research out of the University of Colorado 
suggests a more complicated story for stu- 
dents from one school closed by the Denver 
Public Schools."^ As well, the author does 
not cite the recent report from the Consor- 
tium on Chicago School Research. That re- 
port, When Schools Close, found that school 
closings had a negative impact on student 
achievement unless students transferred to 
substantially higher-performing schools.^ 

Implicit in the discussion of New Orleans, as 
well as the report as a whole, is the assump- 
tion that moving to charter status will lead to 
improved student achievement. However, 
Snell offers little evidence (other than that 
from New Orleans) to support this assump- 
tion. The largest-scale careful analysis that 
has been published to date, out of Stanford 
University, suggests a more mixed picture. 



Seventeen percent of charter schools re- 
ported academic gains that were significant- 
ly better than comparison public schools, 
while 37% of charter schools showed gains 
that were worse than the comparison public 
schools (46% showed no significant differ- 
ence).^ This finding that charters do not on 
average show an academic benefit is consis- 
tent with the overall research concerning 
charter school effects. 

V, Review of the Report ’ s 

Methods 

The New Orleans Story 

As noted, this report rests heavily on find- 
ings from New Orleans to justify the sweep- 
ing changes it proposes. Snell argues that 
“New Orleans students have seen rapid im- 
provement because all schools are charters 
or charter-like” (p. 3).^ However, while im- 
provement in New Orleans is encouraging, 
the achievement story is a complicated one, 
and it is difficult to attribute the increases — 
for at least three reasons. 

First, as the report describes. New Orleans 
school performance scores went up nearly 
10 points from 2004-05 to 2007-08 (from 
56.9 to 66.4), a significant increase (al- 
though one that still left the city far below 
the state average in 2008 of 86.3). However, 
similar improvements are found in the years 
prior to Hurricane Katrina, which struck 
New Orleans at the end of August in 2005 
and which ushered in the dramatic changes 
to the school system. From 2002 to 2005, 
school performance scores in the city also 
rose about 10 points.* As well, during both 
the pre-Katrina and the post -Katrina periods, 
scores went up in many of the state’s other 
school districts and in the state as a whole. ^ 
For example, from 2008 to 2009, 79% of 
schools in the state improved their school 
performance scores.'*^ 
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Second, the devastation from Hurricane Ka- 
trina led to massive out-migration from the 
city, with a disproportionate impact on the 
city’s poorest residents. Prior to Katrina, 
New Orleans public schools enrolled rough- 
ly 65,000 students. Even after several years 
of growth following the precipitous drop 
post-Katrina, public schools in the district 
only enrolled a total of roughly 38,000 by 
October 2009.^^ This shift in population has 
resulted in a city that has a smaller propor- 
tion of families living in extreme poverty 
(household incomes lower than $10,000) 
than pre -Katrina (12.3% in 2005 versus 
6.4% in 2007), as well as fewer minors liv- 
ing in poverty (38.1% in 2005 vs. 31.4% in 
2007). Consistent with general findings, an 
analysis by the Cowen Institute found a very 
strong relationship between the percentage 
of students eligible for free lunch and Loui- 
siana school performance scores. Thus, 
some of the achievement gains in New Or- 
leans are likely due to the city’s schools 
serving a smaller proportion of students fac- 
ing serious financial issues in their homes. 

Finally, the resources available to public 
schools post -Katrina have been significantly 
greater than pre-Katrina. These resources 
have been critical to rebuilding a devastated 
school system. But until the current student 
outcome improvements are able to continue 
without these higher funds, it will be hard to 
attribute achievement gains to the structure 
of the system, as opposed to the available 
resources. The Cowen Institute’s analysis of 
public school spending in New Orleans pre- 
and post-Katrina found that per-pupil public 
spending pre-Katrina was only slightly 
higher than average spending statewide, 
while spending in 2007-08 was more than 
50% higher than the state average. Much 
of this increased funding came through fed- 
eral “restart” monies following Katrina. Mil- 
lions of dollars from foundations have also 
flowed to New Orleans since the hurricane. 



both directly to the city’s two school go- 
verning authorities and individual schools, 
and indirectly to organizations providing 
resources and support to those schools. For 
example, in December of 2007, the bill and 
Melinda Gates Foundation, Eli and Edythe 
Broad Foundation and the Doris and Donald 
Fisher Foundation announced donations of 
$17.5 million to organizations working to 
improve New Orleans Schools; this is only a 
portion of the money that has flowed to this 
relatively small district. In the 2009-10 
school year, all public schools in the district 
experienced significant cuts because of the 
cessation of federal restart money as well as 
stagnant state funding; it is unclear how long 
foundation funding will be sustained at cur- 
rent levels or what additional cuts the loss of 
that money would require. 

The reforms and trends in New Orleans are 
worth noting, and they certainly warrant 
continued attention given the dramatic 
changes in the city’s schools. However, tak- 
en together, there are a host of reasons to 
question the report’s assumption that 
achievement gains in New Orleans are a di- 
rect result of the significant systemic 
changes that the city has experienced. Mak- 
ing broad recommendations for national 
change based on these results seems prelim- 
inary at best. 

Examples of Policies, Not Successes 

The report describes a number of interesting 
policy approaches in different cities that cor- 
respond to changes that the author is advo- 
cating. However, for most of these exam- 
ples, the report does not cite actual research 
showing any link between those policy 
changes and improved student performance 
or outcomes. Nor does the report offer any 
original analyses. Instead, the author often 
cites newspaper accounts or, in some cases, 
provides no sources at all. Table 1 presents 
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Table 1: Primary Examples of City Policy Changes, Used as a Basis for the 
Report’s Recommendations 







Link with outcomes 


Comments 


New Orleans 


Significant enhanced 
autonomy for schools 
and dramatic increase 
in number of charter 
schools 


Improvements in stu- 
dent achievement 


Does not address critical contextual fac- 
tors specific to New Orleans, including 
pre-reform improvements in achieve- 
ment, changes in district demographics 
and dramatic increases in funding post- 
Katrina 


New York City 


Shifts to greater 
school-level empo- 
werment and changes 
in budgeting ap- 
proach 


85% of empowered 
schools meeting per- 
formance targets 


Does not address: percent of schools 
meeting performance targets prior to em- 
powerment, reasons why these schools 
were selected for empowerment, percent 
of “non-empowered” schools meeting 
performance targets, or demographics of 
schools receiving eaq)Owerment 


Oakland 


Increases in budget- 
ing discretion at 
school level, central 
office cuts 


None 


No link with positive student outcomes 


Boston 


Greater principal dis- 
cretion over budget, 
changes in collective 
bargaining for pilot 
schools 


None 


No link with positive student outcomes 


St Paul, MN 


Choice-based enroll- 
ment 


None 


No link with positive student outcomes 


Poudre School 

District (Fort 

Collins, Colora- 
do} 


Choice-based enroll- 
ment 


None 


No link with positive student outcomes 


Baltimore 


Choice-based enroll- 
ment 


District reports that 
families are not choos- 
ing lowest-performing 
schools 


Findings based on newspaper accounts of 
statements by district, rather than on re- 
search 


Denver 


School closure as 
accountability me- 

chanism 


District reports cost 
savings and higher 
performance for stu- 
dents who left schools 
closed for poor per- 
formance 


Data on these findings are not publicly 
available, and therefore cannot be vali- 
dated 



Examples are listed in the order used in the report. 
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some of the report’s primary examples and 
describes the tenuous or non-existent evi- 
dence used to support the report’s proposals. 

VI, Review of the Validity of 

THE Findings And Conclusions 

As described above, this report offers no 
strong evidence in support of the proposals 
it advocates. It relies instead on purported 
improvements in New Orleans that have not 
been subjected to careful analysis. And it 
relies on examples of reforms in other cities 
that often include little or nothing about the 
impact of the reforms on students, families 
or the city as a whole. 



VII, Usefulness of the Report 
FOR Guidance of Policy 
AND Practice 

This report may prove useful for advocates 
of the approaches it describes, as it offers 
some concrete ideas (and lists places to seek 
more information) about how to implement 
the kinds of reforms discussed. However, 
the lack of any meaningful research founda- 
tion for the conclusion the proposed reforms 
would have positive effects limits the use of 
this piece for policy makers or others trying 
to determine the best research-based strate- 
gies for improving urban schools. 
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